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Abstract 

Multi-class systems having possibly both finite and infinite classes are in- 
vestigated under a natural partial exchangeability assumption. It is proved 
that the conditional law of such a system, given the vector of the empirical 
measures of its finite classes and directing measures of its infinite ones (given 
by the de Finetti Theorem), corresponds to sampling independently from each 
class, without replacement from the finite classes and i.i.d. from the directing 
measure for the infinite ones. The equivalence between the convergence of 
multi-exchangeable systems with fixed class sizes and the convergence of the 
corresponding vectors of measures is then established. 
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1. Introduction 

Kallenberg _7J, Kingman ^8_, Diaconis and Freedman [5], and Aldous [T] are among 
many studies of exchangeable random variables (r.v.) with Polish state spaces, a funda- 
mental topic in many fields of probability and statistics. Nevertheless, many models in 
stratified sampling, statistical mechanics, chemistry, communication networks, biology, 
etc., actually involve varied classes of similar objects, which we call "particles". Some 
examples can be found in Graham [3] H] and Graham and Robert [S] . 

Several classical results for exchangeable systems are extended to such multi-class 
particle systems in Graham [5], under a natural partial exchangeability assumption 
called multi-exchangeability. It is notably proved that the convergence in law of a 
family of finite systems, with limit a system with infinite class sizes, is equivalent to 
the convergence in law of the corresponding family of vectors of the empirical measures 
within each class, with limit the vector of the directing measures of each limit class 
(which is exchangeable, and the directing measure is given by the de Finetti theorem). 
This result allows use of compactness- uniqueness techniques on the measure vectors for 
convergence proofs, extending those for propagation of chaos proofs for exchangeable 
systems introduced by Sznitman (TUl and developed among others by Meleard [S] and 
Graham [2111]. We refer to [5] for further motivation. 

In the present paper, we extend this convergence result to multi-exchangeable sys- 
tems with fixed class sizes, which may be both finite and infinite, by showing that their 
convergence in law is equivalent to the convergence in law for the vectors of measures 
with components the empirical measures for finite classes and the directing measure for 
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infinite classes (given by the de Finetti Theorem) . We first extend another result of [5] , 
and prove that the conditional law of a multi-echangeable system, given the vector of 
measures defined above, corresponds to sampling independently without replacement 
from each finite class and i.i.d. from the directing measure for each infinite class, the 
remarkable fact being independence between different classes. 

These new results are related to, and combine well with, those of [5 . For instance, 
results in [5] can yield a tractable large size limit for a finite model of interest, one 
hopes that the long-time behavior of the finite model is well approximated by that of 
the limit, and the new results can help us study all the long-time behaviors and their 
relationship. They can be likewise used for e.g. fluid limits or diffusion approximations. 

All state spaces S are Polish, and the weak topology is used for the space of 
probability measures 'P(iS) which is then also Polish, as are products of Polish spaces. 
For fc > 1 we denote by S(fc) the set of permutations of {1, . . . , k}, and by S](c«) the 
set of permutations of {1, 2, . . . } with finite support. 

2. Some combinatorial facts 

Theorem 1. Let I < k < N and {N)k = N{N ~ I) ■ ■ ■ {N - k + 1) . Sampling k times 
without replacement among N possibly not distinct points xi, . . . , xn G S corresponds 
to sampling from the law 



l<ni,...,nk<N 
distinct 



which is a continuous function (for the weak and the total variation topologies) of 

X^'\xi,...,XN)^-J2s,^eV{S). 



n=l 

S.N,kt 



More precisely, A ' (xi, . . . ,Xff) can be written as a sum of continuous linear func- 

W '^n=i ) for 1 < j < k by an exclusion- 
inclusion formula. Sampling k times with replacement corresponds to using the law 

Proof. The statements about the laws used for sampling without and with replace- 
ment are obvious. Sampling from A^''^(a;i, . . . ,X7v) corresponds to sampling k times 
without replacement from the atoms of X]n=i counted with their multiplicities, 
and this fact clearly implies the continuity statement. More precisely. 




l<ni,...,nk<N 

j = l l<ni,...,nfc<JV 
Card{ni ,. . . ,n;^. }— j 

where the term of index j in the sum is a continuous linear function of A^'^ (xi , . . . , xat) , 
and since j < fc — 1 we conclude by recurrence over fc > 1. 
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The following result quantifies the difference between sampling with and without 
replacement in variation norm ||/i|| = sup{ (0, /i) : \\<t>\\oo < 1 }■ See also pQ Prop. 5.6 
p. 39] and [3 Theorem 13 p. 749]. 

Theorem 2. With the notations of TheoremUl we have 

\\\N.kf^ ^ \ \N.1(^ ^ ^^8)fc|| ^ n -^^ ~ ^ ^{k - 1) 
A ■ (Xi, . . . ,Xn) - A ■ [Xi, . . . ,Xn) < Z —J < 



and the first inequality is an equality if and only if the Xi, ... , Xjv are distinct. 

Proof. Equation ([1]) yields the first inequality for the variation norm, and the 
condition for it to be an equality. The second inequality follows by bounding — {N)k 
by counting fc(fc — l)/2 possible positions for two identical indices with N choices and 
j\fk~2 gj^QjQgg for the other k — 2 positions. 



3. Multi-exchangeable systems 

3.1. Reminders on exchangeable systems 

Let N E N = {0, 1, . . . } be fixed. A finite system (^n)i<„<jv of random variables 
(r.v.) with state space S is exchangeable if 

The empirical measure of the system is the random probability measure 

1 ^ 

A^ = A^-i(Xi,...,X^) = ^^Jx„ (2) 

n=l 

with samples in 'P{S). The conditional law of such an exchangeable system given its 
empirical meausure is A^'^(Ai, . . . , Xn), see Theorem[T]for the definition of A^'^ 
and e.g. Aldous [H Lemma 5.4 p. 38] for the result. 

An infinite system {Xn)n>i is exchangeable if every finite subsystem {Xn)i<n<N is 
exchangeable. The de Finetti Theorem, see e.g. [71 [H 12 H] > states that such a system 
is a mixture of i.i.d. sequences, and precisely that its law is of the form 

J P'^°°CA^idP) 

where Ca^ is the law of the random probability measure 

A°° = lim A^'i(Ai, . . . , Xn) = lim — V (5x a.s. (3) 

n=l 

called the directing measure of the system. The conditional law of such a system given 
A°° corresponds to i.i.d. draws from A°°. 

3.2. Multi-class systems 

In order to consider finite and infinite systems simultaneously, we will take class 
sizes in N U {oo}, and be redundant for clarity. Let C > 1 and A'i G N U {oo} and state 
spaces Si be fixed for 1 < « < C, and consider a multi-class system 

iXn,i)i<n<Ni, i<i<c , Xn,i with statc spacc Si, (4) 
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where the r.v. Xn^i is the n-th particle, or object, of class i, and 1 < n < oo is 
interpreted as n > 1. We say that ([5]) is a multi- exchangeable system if its law is 
invariant under finite permutations of the particles within classes, and precisely if 

^{i^ai{n),i)l<n<Ni. l<i<c) — ^ ) l<n<7Vi , l<i<c) , V(Ti G S(-/Vi). 

This natural assumption means that particles of a class are statistically indistinguish- 
able, and obviously implies that {Xn^i)i<n<Ni is exchangeable for all i. It is sufficient 
to check that it is true when all ct^ but one are the identity. 

For a multi-exchangeable system, a fundamental quantity is the random vector of 
probability measures, with samples in V{Si) x • ■ • x V{Sc), given by 



(Af*)i<i<c , 



A, 



Ni _ 



the empirical measure given by (P| if Nj < oo 
the directing measure given bv ([3]) if A^,- = oo . 



(5) 



The following extends the results in Section [XTl as well as Graham [5, Theorem 1] 
and Aldous [2 Cor. 3.9 p. 25] in which respectively Ni < oo and Ni = (x for all i. The 
remarkable fact is conditional independence between different classes. 

Theorem 3. The conditional law of a multi- exchangeable system ^ given the random 
measure vector (A^')i<i<c in ([S]) corresponds to drawing independently for each 
class i, if Ni < oo from A^*'"'^'(X„.i, . . . , Xn^jVi) given in Theorem[Jl i.e, without 
replacement from the atoms of the empirical measure A^" — i counted 

with their multiplicities, if Ni = oo in i.i.d. fashion from the directing measure A°°. 



Proof. Let l<fc<M<oobe arbitrary and, for 1 < i < C, 

k, ^ M, = Ni if Ni < oo , h^k and AL = M if A^,; = oo . 



(6) 



Since A^' does not change if one applies a permutation to (^n,i)i<„<Afi j see ([S]), multi- 
exchangeability implies that for all /, e C6(5f ' , K) and g e Cb{V{Si) x ■ ■ ■ xV{Sc),R), 
with the notation in Theorem [U 



E 



)l<i<C 



— y 

Ml' ^ 



(TieE(Mi 



Mr I 



(TceS(Mc) 



c 



E 



E 



N 1 

i=i CTes(Mi) 
c 



(7) 



Considering ([6]), if A^i < oo then A*^-*^' (ATi,,, . . . , ATa,,,,) = A^-^- (ATi,,, . . . , ATat,,,), and 
if iVj = oo then we let M go to infinity and use Theorem^ ([3]) , continuity, boundedness. 
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and dominated convergence, and we obtain 

c 



E 



i=l 

C 

g((Af-)i<»<c) n (/- Iw.<ooA^"^-(Xi,„ . . . , X 



E 



i=l 



(8) 



and we conclude using that k > \ and g, fi G Ch are arbitrary, the spaces are 
Pohsh, A^''^'(Xi_i, . . . ,Xjv.^i) depends measurably on Af'' — A^''"^(Xi^i, . . . , Xjv._i) 
(see Theorem [IJ, and the characteristic property of conditional expectation. 

Thus, the classes of a multi-exchangeable system are conditionally independent given 
(Af^')i<i<C, with conditional laws as for an exchangeable system and depending on 
whether the class is finite or infinite. Given (A^')i<i<c' no further information can 
be attained on the law of the multi-exchangeable system by further observation, in 
particular involving r.v. in different classes. A statistical interpretation is that the 
empirical measure vector is a sufficient statistic for the law of the system, the family 
of all such laws being trivially parametrized by the laws themselves. 

We now extend the convergence results for exchangeable systems in Kallenberg [71 
Theorem 1.3 p. 25], see also Aldous [3 Prop. 7.20 p. 55] when A^i < oo, to a family of 
multi-exchangeable systems, of fixed possibly both finite and infinite class sizes. 

Theorem 4. Let C > 1 and iV^ e NU {oo} and state spaces Si he fixed for 1 < i < C. 
For r e M+ U {oo} let 



n<n<Ni,l<i<C ■ 



j with state space Si , 



be multi-exchangeable systems as in and {Af"^)Ki<c be as in Th 



if and only if 



lim {X^ i)i<n<m,i<i<c = (Ar,fi)„>i ,i<j<c in law 

r — ^oo ' ' 

lim (Af*''')i<i<c = (Af*^°°)i<i<c in law. 

r — *oo 



Proof With the notation (HD, let fc > 1 and /; e Cb(S^' ,R) ior 1 < i < C 
be arbitrary. Taking g = 1 in ([5]), or conditioning first on (A^''''')i<i<c SLud using 
Theorem [3l yields 

c 



E 



E 



and hence if lim^ 



■ c 



.(Af-'O^') 



(9) 



l<i<C 



= (Af-°°) 



l<i<C 



in law then 



lim E 



E 
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using the continuity result in Theorem [H which proves the "if" part of the theorem 
since A; > 1 and fi are arbitrary and the state spaces are Polish. The converse follows 
similarly from ^ with functions fi depending only on the first variable. 
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